Combining Color, Depth, and Motion for Video Segmentation
نویسندگان
چکیده
This paper presents an innovative method to interpret the content of a video scene using a depth camera. Cameras that provide distance instead of color information are part of a promising young technology but they come with many di culties: noisy signals, small resolution, and ambiguities, to cite a few. By taking advantage of the robustness to noise of a recent background subtraction algorithm, our method is able to extract useful information from the depth signals. We further enhance the robustness of the algorithm by combining this information with that of an RGB camera. In our experiments, we demonstrate this increased robustness and conclude by showing a practical example of an immersive application taking advantage of our algorithm.
منابع مشابه
Real-Time 2D to 3D Video Conversion using Compressed Video based on Depth-From Motion and Color Segmentation
This paper provides the conversion of two dimensional (2D) to three dimensional (3D) video. Now-a-days the three dimensional video are becoming more popular, especially at home entertainment. For converting 2D to 3D, the conversion techniques are used so able to deliver the 3D videos efficiently and effectively. In this paper, block matching based depth from motion estimation and color segmenta...
متن کاملMultiview video depth estimation with spatial-temporal consistency
In this paper, we present an approach to recover both spatially and temporally consistent depth maps from multiview synchronized and calibrated video streams. Depth maps are initialized by combining left-right view matching and color based segmentation. Then the color constancy and spatial coherence are integrated into the optimization framework in order to guarantee the spatial consistency at ...
متن کاملLong-term moving object segmentation and tracking using spatio-temporal consistency
The success of object-based media representation and description (e.g., MPEG-4 and –7) depends largely on effective object segmentation tools. In this paper, we expand our previous work on automatic video region tracking and develop a robust-moving objects detection system. In our system, we first utilize innovative methods of combining color and edge information in improving the object motion ...
متن کاملMotion-based analysis and segmentation of image sequences using 3-D scene models
In this paper we present an algorithm for automatic extraction and tracking of multiple objects from a video sequence. Our approach is model-based in the sense that we first use a robust structure-from-motion algorithm to identify multiple objects and to recover initial 3-D shape models. Then, these models are used to identify and track the objects over multiple frames of the video sequence. Th...
متن کاملDense Structure-from-Motion: An Approach Based on Segment Matching
For 3-D video applications, dense depth maps are required. We present a segment-based structure-from-motion technique. After image segmentation, we estimate the motion of each segment. With knowledge of the camera motion, this can be translated into depth. The optimal depth is found by minimizing a suitable error norm, which can handle occlusions as well. This method combines the advantages of ...
متن کامل